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ABSTRACT 


In Ocean investigations, particularly those deployed by the Autonomous 
Underwater Vehicles, underwater object detection and recognition is an 
essential task. Edge detection places a key role and considered one of the 
pre-processing techniques for several deep learning applications. In an 
underwater environment, the illumination of light, turbulence in the water, 
suspended particles present in the seafloor are challenging issues to acquire 
the quality image. The two major problems in underwater imaging are light 
scattering and color change. In the former case, the vision sensors connected 
to the underwater vehicles or dive lights used by the divers themselves cause 
light dispersion and shadows in the seafloor. In the latter case, the occurrence 
of color distortion is mainly due to the attenuation of the light, hence the 
images are having dominant colors in the latter case. The conventional 
techniques are failed to detect the quality edges in the case of underwater 


L*A*B model images. Our mechanism focused, instead of applying the edge detection 
algorithm on the input image directly, it is better to apply edge detection 
algorithm after color correction and contrast enhancement using L*A*B 
model. Qualitative and quantitative test results demonstrate that the proposed 
mechanism is giving better results compared with state-of-the-art methods. 
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1, INTRODUCTION 

Underwater imaging has grabbed many eyes and used comprehensively in scientific research in this 
decade. Acoustical images are crucial in several real-time applications, for example, marine geology, 
commercial fishing, resource searching, an inspection of pipelines and maintenance, object detection and 
recognition, etc. Due to the abnormal environmental conditions in underwater, the acquired images include 
absorption, light scattering, and other related noise [1], causes the image to be poor in contrast, deviated by 
blue or green in color and the objects at distance more than 15m are visually unclear [2]. Consequently, 
emerging methods are required to restore a high-quality image from the degraded image for underwater 
imaging. Numerous methods have been developed such as applying median filter [3], adaptive based 
thresholding [4], IBP reconstruction [5], etc. to increase the contrast in the outdoor images, but only few 
research works are done to restore/improve the contrast in the underwater images. Fattal [6] evaluated the 
scene radiance and computed the transmission map for a single image. He et al. [7] introduced a Dark- 
Channel Prior method (DCP), which effectively works on outdoor hazy images, but gives poor results for 
grayscale and underwater images. The authors in [8, 18] applied the DCP method directly to the underwater 
images. Chiang and Chen [9] proposed a method that combines 2 methods i.e. dehazing and wavelength 
compensation for image restoration. Ancuti et.al. [10], used the fusion principle to intensify the quality of the 
image and video. According to Galdran et.al. [11], by considering the color with the shortest wavelength 1.e. 
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red channel, the contrast of the image will be increased. Tang et al. [12], uses a learning strategy for haze 
removal by updating the transmission map with distinct features. By considering the optical properties of 
water with background lighting Zhao et.al [13] proposed a method by modifying the transmission maps to 
three sub-channels to enhance the contrast. In addition to these techniques, there exist many other studies to 
enhance degraded images [14, 15]. However, these techniques are well applicable to enhance the terrestrial 
images, but not efficient for submerged images. Edge discovery is one of the most essential steps in image 
processing and image analytics for image segmentation, image enhancement, pattern recognition, etc. 
The conventional techniques such as Roberts, Canny, and Sobel, etc. are having some limitations and failed 
to detect accurate edges for underwater images. In this paper, we proposed a method to improve the edge 
detection results using a preprocessing method. To get a clear understanding of this, first we briefly explored 
the image enhancement techniques i.e. image restoration, and image enhancement. Former methods 
recovered the original image by utilizing a physical model, includes diffusion, water turbidity, depth, etc. for 
example, original image 0 (p, q) 18 recovered from the captured image c (p, q) with the help of degradation 
function d (p, q). Mathematically, the image restoration model 1s shown in (1) 


c (p, q) = o(p, q) * d(p, q) + n(p, q) (1) 
Here “*” is convolution, n (p, q) 1s noise, and (p, q) 1s the pixel coordinates of the image. As shown 
in (1) can be written as (2) in the frequency domain. 


C (u, v) = OG, y) D (u, v) + N (u, v) (2) 


On the other hand, image enhancement does not consider the physical properties of image formation 
unlike image restoration to increase image quality. Image enhancement methods are simpler and getting the 
result faster than image restoration methods. As we go deeper into the seafloor, the colors are diminished one 
after the other based on its wavelength. Since the blue color has the lowest wavelength most of the 
underwater images are in a bluish tone. These colors are considered to be a dominant color in our case. 
It is better to reduce these dominant colors in the image as a preprocessing task for any segmentation 
algorithm. It 1s quite straightforward for human beings to find the dominant colors in the image.This task will 
be done by the most interesting unsupervised algorithm called, k-means clustering [19]. 

The objective of the k-means clustering 1s, it takes an image as input, it shows the topmost (1.e. n=3) 
dominant colors in the image. In other words, the size of RXC number of pixels is given as input and we are 
clustering these pixel values of the color image. If the input is a grayscale image, we can find the top most 
gray-color values that are very close together. For a color image, each pixel is subdivided into three 
subcomponents such as Red, Green and Blue colors. For example, the pixel intensity 1s (17, 25, and 40). 
We are trying to extract the colors that are mostly occupied in the given image (dominant colors). The input 
and the corresponding dominant colors (n=3) in the image are shown in Figure 1. In the case of underwater 
images, due to the illumination and wavelength of the colors, the image almost looks either in blue or green 


Clustered results 


Input Image 





(b) 





Figure 1. K-means clustering for getting dominant colors 
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In color. Two images, one with green as dominant color (Figure 1(a)) and the other one is blue as a 
dominant color (Figure 1(c)), and the results can be seen in Figure 1(b) and Figure 1(d). After reducing the 
dominant colors, can we directly apply the edge detection algorithm to get the accurate edges? As per the 
best of our knowledge, the answer is No, since the image is captured under the water, the contrast is still low. 
The authors in [20] have applied CLAHE on the two-color models such as RGB and HSV. Bin Parsusah et.al 
[21], proposed an adaptive neuro-fuzzy method for color object detection in robotic systems. The RGB color 
model portrays colors in terms of Red, Green, and Blue. CLAHE can be applied to these three segments 
(R, G, and B) separately and the final output is produced by consolidating all three segments together. HSV 
depicts the colors in terms of Hue, Saturation, and Value. At the minimum or maximum intensity level, 
the hue and saturation don’t make a distinction. It takes the RGB values as the input and converts these 
values into a range of [0, 1]. In other words, all the pixel values are normalized within the range of [0, 1]. 
Another important issue here is, identifying the accurate edges for the dominant colored images. As per the 
studies, there is no single algorithm for edge and object detection, which works efficiently for all these cases. 
The reliability of edge detection results will be the effect of the results of the further stages in image 
processing such as target detection and recognition in the images. Several researchers proposed numerous 
edge detection strategies and categorized as parametric models, gradient-based, etc. The existing algorithms 
work well for the outdoor images in the proper lighting conditions, but in the case of the underwater 
environment, the lighting conditions are completely different. The traditional algorithms for example, if we 
apply canny edge detection algorithm for underwater images, 1.e. in which almost the background color is 
green, gave very poor edge detection results. We proposed an elective technique to get a better outcome. 
Two other works, done by different authors to restore the color and to increase the quality of the input. 
First, Kim et.al proposed a method to restore the color with the help of transmission parameters and local 
patches. The cost is computed with the help of the cost function shown in (3). 


F const (t) =F unit (t) =i std (t) (3) 


Here functions Fynit (t), Fea (t) describes uniformity, the standard deviation for a specific value of ‘t’ 
in the patch. When the cost function is minimized then the transmission parameter is determined. However, 
this technique fails in restoring the colors present in the image and sometimes it gives distortions in the color 
by contrast stretching. Second, DCP method restores the colors but it concentrates very less on the contrast 
present in the image. We motivated with the limitations of these two methods and proposed a method, which 
restores the color along with contrast enhancement. The proposed method is broken down into three stages 
after the image acquisition process (See Figure 2). First, we have applied a color correction algorithm on the 
input image, this will give a color corrected image as output in which the dominant colors will be diminished. 
Secondly, a Contrast Limited Adaptive Histogram Equalization (CLAHE) applied to the color corrected 
image using the L*A*B color model. Finally, we applied the threshold-based canny edge detection algorithm 
for the current image, which gives better object regions compared to the method of directly applying it. 
The results are also compared with other contrast enhancement models such as Histogram Equalization (HE), 
DCP and with edge detection methods 1.e. Sobel, Prewitt. 


2. RESEARCH METHOD 

The primary goal of this work is to find the accurate edges from the underwater image. As a 
preprocessing step, we first reduced the dominant colors, followed by contrast enhancement using the L*A*B 
color model. Finally, we applied a threshold-based canny edge detection algorithm to find the better edges. 


2.1. Color Correction 

Objects present in an image are unique in the submerged environment due to the poor illumination 
against the image captured in the normal environment. The key reason 1s that seawater abstractly differs from 
its wavelength of the light. Additionally, unique suspended particles exist in the water, diminish the general 
quality and nature submerged image [18]. We proposed a color correction algorithm, which produces the 
image should look like a natural image (See Algorithm 1). The input for this algorithm is an underwater 
image, Irpgg and the percentage, p. We split the input image into three separate channels 1.e. Ip, Ig, Ip, since 
from (4) and (5) 
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Image Acquisition 7 Color Correction 
Threshold based Canny Edge Contrast Enhancement using 
detection algorithm L*A*B color space 


Figure 2. Flow of the proposed method 





Algorithm 1: Color Correction 
Input: Underwater Image Ipcp, Percentage (p) 
Output: Color corrected image (Cl rcp) 
1: Read Igcp, p 
2: if channels (pcp) — 3 && O<p<100 
Compute HP © p/200 
Ir, Ig, Ip © split Urgs) // Ircg = {Ir U Ig U Ip} 
for each Ip, Ic, and Ip 
H, W € shape (Ip) 
calculate VS < H *W 
Ip © reshape Ip of VS size // 2-dimensinal matrix 
low © min (row (Ig), column (If)) && high © max (row (If), column (Ip)) 
10: Threshold (Ip); low < Ips high 
11: Ip © Normalize (Ip) 
12: repeat step 6-11 for Ig, and Ip 


oe ee 


13: end for 

14: Clrcp a merge (Ir, Ic ; Ip) // {Ip U Ic U Ip} = Clrcp 

15: end if 
Ircp= UxerG.B I (4) 
Nker,GB i =9@ (5) 


For each channel, we compute the vector size as the product of the height and width of the two- 
dimensional matrix as in step 7. Now, reshape the red channel into the size of VS and find the minimum and 
maximum value in each Ip as shown in step 9 in the algorithm. Later, the thresholding and normalization are 
performed (step 10, step 11). We repeat the same process to Ig and Ig and finally merge the channels back as 
shown in step 14. We have taken two sample underwater images Figure 3(a) and Figure 3(c) and the result is 
shown in Figure 3(b) and Figure 3(d). 


Input Image 





Color Corrected Result 








(d) 


Figure 3. Color correction of different images 
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2.2. Contrast Enhancement 

The second step in our work is, increasing the contrast of the color-corrected image. To accomplish 
this task, we used the L*A*B model, instead of increasing the contrast in the RGB model. In general, 
color images contain more accurate information rather than grayscale images. In addition to L*A*B and 
RGB color models, there exist a few other color models include CMYK and Y-Cb-Cr. In the L*A*B color 
model, the differences in the color which we see corresponds to the distances when measured 
colorimetrically. Histogram equalization unpredictably increases the contrast in the image as a consequence, 
if an image contains huge noise, then noise also gets improved. In Adaptive Histogram Equalization, 
the regions are enhanced in a relatively small range. To reduce the enhancement in the noise we can utilize 
the CLAHE as an extension for AHE. The image, which is obtained after the color correction will be given as 
input to the contrast enhancement algorithm [20]. First, we have converted the image into its L*A*B color 
space and the channels are decomposed separately. We omitted the channel A and B channels, which has less 
impact and CLAHE 1s applied on the lightness channel. The enhanced result of channel “L’ is now merged 
with A and B channel, to get the final result and is converted back to the RGB color space. We have taken 
different underwater images applied our methodology to increase the contrast in the input image as shown in 
Figure 4. We combined the contrast enhancement and edge detection algorithms together in Algorithm 2. 
Step | to Step 7 of Algorithm 2 describes the contrast enhancement. The input for Algorithm 2 is Clegp and 
converted into I, ag. Now the image is split into three separate channels 1.e. I, I,, and Ip. The patch size is 8 X 
8 and the clip limit was taken 3.0. Now we applied CLAHE on Lightness channel and the result of this is 
merged with I,, Ip and the output image is stored in Orcs. 


Input Image Enhanced Image 


—_—_ 











Figure 4. Contrast enhancement using L*A*B model 


2.3. Edge Detection 

Edge discovery in an image is a critical step for some imperative applications, for example, machine 
vision, object detection. According to the existing studies, there are several edge detection algorithms 
categorized as gradient-based, template matching, and parametric, etc. are having several issues in the 
detection of edges for underwater image [23]. We can utilize the edge detection results in several automatic 
foreground extraction applications [24, 25], but still, it is a challenging issue to detect the efficient edges for 
applications such as ocean and oceanography. Low Error Rate, Good Localization, minimal response are the 
three important criteria of the optimal canny edge detection algorithm. The steps 8-12 describe the canny 
edge detection process. The algorithm is almost similar to the canny edge detection algorithm, except the 
manual threshold. In this, we detect the number of edges based on a parameter. If we increase the parameter, 
we get more edges, 1.e. over edge detection results, 1f we decrease the parameter then we get fewer edges 1.e. 
under edge detection result. The number of accurate edges also depends upon this parameter. The image will 
be smoothed using a 7x7 Gaussian filter to decrease noise. The Gaussian function of a 1-D signal is 
shown in (6). 
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Algorithm 2: Edge Detection using CLAHE with L*A*B Model 
Input: Clegg (Color Corrected Input Image) 

Output: ERg (Binary Edge detection Result of Input image) 
: Read the current image 1.e. Clacp 

‘Than © Clrop 

i I. I, Ip < split (hap) 

: initialize clip_Limit < 3.0 && Grid_Size € 8 X 8 

: Ig, < CLAHE (I,) 

‘ lout < merge (Ic; I Rs I 3) // {Top U I, U Ip} = lout 

Orcs © lour 

‘ Os < Smooth (Orcp; K7) 


9: Compute Magnitude © \/S,2 + Syz2 && Direction © Tan” *y 


Sx 


OANMNKWNY 


10: O; < Non- maximum suppression (Os) 
11: OT; © Threshold (Os, H, L) 
12: ERg © Filter (OTs, Hr) 


G(x) = —S eae (6) 


Once the image 1s filtered, the magnitude and orientation of the gradients are calculated as shown in 
step 9. To remove the false responses, non-maximum suppression is performed in step 10. Finally, weak 
edges are removed by hysteresis thresholding. Figure 5(d) shows an example of an edge detection result for 
the input image Figure 5(a), we also have shown the color corrected and CLAHE output in Figure 5(b) and 
Figure 5(c). 





(a) (b) 


(d) 


Figure 5. Result of edge detection. a) input image, b) color corrected image, c) contrasted image, 
d) edge detection result 


3. RESULTS & DISCUSSION 

In this section, we presented the experimental study along with the qualitative and quantitative 
comparison. To compare the edge detection qualitatively, we have taken one underwater image and 
compared our result with the other edge detection algorithms. Figure 6(a) 1s the input underwater image. 
If we apply the canny edge detection algorithm without applying any filter, we identified the edges as shown 
in Figure 6(b) For the same input, we applied the Sobel edge detection algorithm and observed the result 
(Figure 6(c)). Later, we increased the contrast of the input image using HE, DCP and then applied the canny 
edge detection. Figure 6(d), Figure 6(e) are the results of these methods. Figure 6(f) is the outcome of our 
proposed work and identified better edges compared to the other algorithms. In our objective comparison, 
we considered 3 measures i.e. Entropy, MSE, and PSNR. Entropy or Average Information Content (AIC) 
computes the total information in the image and this value should be higher for a better case [22]. AIC can be 
computed from 0 (7) 


AIC = - Y=5 P(k) log P (k) (7) 
We computed the entropy for numerous images and four of them are presented in Table 1. We have 
computed the Mean Square Error (MSE) and Peak Signal Noise ratio (PSNR) and compared the results with 


HE and DCP methods (See Table 2). The Mean Square Error can be computed as shown in. (8). The value of 
the MSE should be always minimum and PSNR should be maximum for the better results. 
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(a) (b) (c) (d) 


Figure 6. Comparison Result. a) Input image, b) Canny Edge Detection Result, c) Sobel Operator Result, 
d) Canny Edge Detection After applying HE. e) Canny Edge Detection after applying DCP, f) Our result 


Table 1. Comparison of Entropy for Various Underwater Images 


Image/Method Original HE DCP Proposed 
Bali2 6.93784 7.61525 7.00425 7.71105 
Ancutil 6.7404 6.69169 6.64665 7.76871 
turbine 7.03684 6.98520 6.88752 7.64631 
Ancuti8 6.28142 6.23598 6.64665 7.6904 


Table 2. Comparison of MSE, PSNR for Various Underwater Images 


Image/Method HE DCP Our Result 
MSE PSNR MSE PSNR MSE PSNR 
Bali2 9225.60 8.48 3971.15 12.14 1199.99 17.33 
Ancutil 4073.53 12.03 2927.96 13.46 3797.53 12.03 
Turbine 4006.67 12.10 5780.31 10.511 1018.00 18.05 
Ancuti8 7211.16 v5) 4496.67 11.60 2493.36 14.16 


4. CONCLUSION 

In this work, we proposed a new mechanism to detect the edges, rather than using conventional edge 
detection algorithms. We applied a preprocessing mechanism to get improved edge detection results. As a 
first step, we have removed the dominant colors exist in the image so that we can get the image almost 
similar features to exist in the terrestrial image. Instead of applying the CLAHE algorithm to the RGB 
channels, applying the lightness channel in the L*A*B color model will avoid an increase in the noise in 
other channels. It is possible by splitting the channels and merging it back after applying CLAHE to the 
channel “L”’. After converting the L*A*B color image to RGB, a manual threshold canny applied to detect 
edges. We took Prewitt, Sobel, into account for comparison and obtained better results. Although our method 
is giving excellent results to detect the shape of the object, there is a small amount of noise still exists. 
Eliminating the noise from the edge detection result and applying this method to deep networks for 
automation is considered as our future work. 
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